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FACUm PERCEPTI0;]3 OF STUDENTS 



IV. Desirability and Perception of Academic Perforniance 

Ab, 5 tract 

A previous study in this series was devoted to the definition, using the 
diagonal method of factoring, of student desirability separate and apart 
from academic performance. Variables employed consisted of ratings of 
students by faculty on 30 traits, as well as high school and college grade 
averages and SAT scores. 

In the present study, the same data and similar methods were employed 
to determine the nature of desirability separate and apart from the rater's 
perception of the student's academic performance (rather than his actual 
perfoi maAice ) . 

The results tena to show an absorption in the faculty perception of 
performance of much of the variance previously associated with dependability, 
intellectual ability and values^ motivation, self-sufficiency/creativity, 
and maturity in defining desirability apart from academic perfoiriance . The 
results tend, however, to verify or accentuate the contribution of other 
traits, notably ethicality, likableness, open-mindedness, and altruism. It 
does appear that desirability is highly related to perception of academic 
performance, and that other areas normally expected to make an honest 
cor 4 tribution to performance (e.g,, dependability. Intellectual ability and 
values, motivation, and self-sufficiency/creativity) are perceived by the 
faculty to do so. Finally, there is remaining reliable variance in SAT and 
actual grades, as well as in such previously established areas as conformity 
and extraversion, which is related neither to perception of performance nor 
des**rability. 



FACULTY PERCEPTIONS OF STLTENTS 



IV. Desirability and Perception of Academic Performance 



Introduction 



In a previous study (DaviS; 1964b) concerned vith faculty definition 
of the desirable student, multi- trait ratings of students by faculty vere 
employed to determine the nature of desii’ab ility separate and apart fz’om 
acaderaic performance. As general desirability, academic performance, and 
positive rating? on other traits are iiiterrelated, the problem involved (a) 
establishing a criterion of academic performance, (b) using statistical pro- 
cedures to separate out that portion of reliable variance in aesi?’ability and 
the ether trait ratings that is not attributable to differences in academic 
performance , and (c) determining interz^elationships among these residuals. 

Thus, using the fi-eshman grade-point average (FGFA) as the criterion of 
acaderaic performance, it vas found that faculty define desirability separate 
and apart from academic performance primarily in terras of Intellectual values, 
ethleality, likableness, independent creativity, open-minde'dness, altruism, 
maturity, and self-insiglrt . 

However, the subjects were students in the raters ^ classes, and it may 
be assumed that the r'jters have firsth.and knowledge of each student’s per- 
fornance • Some of the variance found in desirability apart from FGFA may be 
attributable to variance in the faculty member’s perception of the student's 
perforiTiancei sor.e of the variance that desirability and FGFA have in common 
may not be attributable to the rater’s perception of perfonnance, which may 
differ from FGPA as a function of the pai'ticular course area or instructor. 
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Th(? present analysis^ then^ is directed toward the definition of desir- 
ability apart from perception of performance rather than from the consensus 
expressed by TOPA. Do the previous components hold? Also, what traits are 
related to the individual perception of performance? 

Subjects and Basic Data 

The 696 sets of ratings employed in the basic study (Davis, 1964b) were 
again used for this analysis; the.,: involved -iK)? faci;lty raters and 398 stu- 
dents at eight institutions , Good communality estimates, essential to the 
diagonal factoring methiod co be employed, were drawn from factor analyses 
performed as part of the broader study* The ratings were those provided by 
the Studen*^ Patlng Pom (Ds.vis, 1964a), whore 80 traits, plus SAT-V, SAT-M, 
High School Rank, and Freshman Average Grade provided variables for the 
84 X 84 matrix. 



Procedure 

The diagonal method of factoring (Thur stone, 194?) was employed. This 
procedure permits removal of that portion of the reliable variance in one 
measure that is related to a given criterion, to pem:it identification o"' 
the remaining reliable variance in the measure, through correlates, which 
is not related to the criterion. 

A first factor was defined by a vector placed through the criterion, 
a rating-scale variable calling for rating on "academic performance.*' The 
residual variance for a measure of desirability, defined by a rating of the 
student as "the kind of student the institution should (or should not) admit. 
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was used to define a second orthogonal factor- Loadings of the other rating* 
scale variables, and SAT-V, SJ'T-M, High School Rank, and FGPA were computed 
for these two factors, Thu^, the first factor absorbs all the variance in 
the academic perfonnance rating; leadings of other variables on this factor 
show the extent of reliable associated variance. The second factor is, by 
definition, desirability apart from what is measured by Factor I, and load- 
ings of other variables on Factor II may aid in defining it- Finally, a 
third factor was defined by placing a vector through a point defined by the 
SAT-V residual (after the variance attributable to perforniance and desira- 
bility was removed), to determine the nature of remaining reliable variance 
in SAT. 



Results and Discussion 

Results are presented iii fable 1, which provides rating -sc ale item 
identification, communal! ties, loadings on the three constructed factors, 
and residual communalitles . (For ready comparison, comparable data from the 
previous stutly are reproduced as ‘fable 2.) Rating-scale variables are 
grouped in clusters Indicated by a separate factor analysis employing the 
equlmax rotation (Davis, 1961c), 

It is immediately apparent from these data that desirability apart from 
rater perception of perfonnance does not seeia as complex as does desirability 
apart from actual grade performance^ In uhe first place, the loading of 
desirability on perception of perforTnance is *7?, against a value of .45? 
(Table 2), on FGPA. This not only implies that desirability is more highly 
related to what the instructor believes performance to be than to what it is 
(or was , through the freshman average), but also that the second factor- - 



’actor Loadinr;^: Dloijonal Factoring with Vectors Placed Thi'ough B'creptlon r.f Academic Performance (l), Desirahillty (ll), and GAT-V (ill) 
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desirability apart from performa.ice--has a much smaller portion of variance 
left to define it* Tnirty of the other ratir.g-scale items load higher on 
Factor II than does x'ecidual desirability. Second^ many of the clusters of 
items which loaded higher 02} Factoi" IT than on I in the original analysis 
(Table 2) novr give the higher loadings to Factor I. In fact; the loadings 
on Factor I gain and the loadings on Factor II lose, In most cases. Notable 
exceptions where loadings on Factor II ga in in the present analysis include 
the following variables: honest, accs ethically, likable, affable, fair- 

minded; high concern for welfare of others, altruistic, interested in others, 
liked by peers, not status-centered, and modest. Dei^endabl lity variables 
become almost entirely a matter of perception of peifonnance, as do ratings 
of t>'aits grouped ^nder intellectual ability, motivation, and self- 
sufficiency/creativity. Ratings under ethical! ty, likableness, and altruism 
remain, from the original group, as the only areas w’here loadings on per- 
formance tend to be low and loadings on the desirability residual tend to 
be high, 

Instrament factors surely account for part of the different results for 
rating-scale variables in the present analysis. Halo in the ratings probably 
accounts in large part for the fact ‘.hat more variance is absorbed in a first 
factor defined by a criterion internal to the instrument. Consid^^ring the 
low loading of the dec irabili'^y criterion on the factor it defines and the 
fact that many rating- scale Vi,riables load higher on this factor than does 
the desirability criterion, ary generalizations should be tempered by the 
obvious difficulties faculty have in separating desirability from perception 
of performance that may in this situation stretch the meaning of the second 
factor to other areas. 

o 
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It is interesting to note 1;hab SAT s.n6 High School Hank do not relate 



as highly to the instructor's perception of perfoi'mance ao to the fresliirjan 
grade-point average, although greater reliability of TOPA could, of course, 
account for this, t’evertheless, the relationship of SAT and HSR to desira- 
bility apart from perfomarxe is, as before, negative , a:: Is now the rela- 
tionship of FGPA, 

Whatever may constitute Factor II, actual grade pe:'U‘orjT'asca is not rec- 
ognized in any positive sense; indeed, this would not 1 -j cxpccteu, Ihis 
residual desirability factor, by its construction, defines a student not 
recognized for his perfomance, but who is desirable on other grounds* This 
student emerges as one of lower actual perf'onnance and lov^er SAT scores, but 
who stands cut as honest and ethical, pieasant and cooperative, interested 
in and concerned for ethers, and not status -centered, He is a comfortable 
person to be with, thrugh (in traits not associated with performance) neither 
particularly extraverted nor introverted, conforming nor nonconforming, 
anxious nor free from anxiety, He is not fraught with problems that make 
him appear anxiety-ridden, unorthodox or ;dd, unpopular, unevenly motivated 
or uniquely creative; he appears to be a pretty stable, pleasant, noncontro- 
versial sort, valued for the fact that he is not an irritant, or beca'ise he 
is on the right side of the I :*oader societal values. 

Cf greater i^ipo^t in this analysis, perhaps, is the insight it provides 
about the faculty "" j'mulation of "good'* perfoinnance . Loadings on Factor I, 
perceptions of performance, show that faculty believe that those who perfonii 
are Industrious and work oriented; able (however ability may be conceived); 
interested In ideas 02 ' int^'llectually curious; motivated, serious, and eager 
to learn; and imaginative, independently creative. They do not, as noted, 
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relate perceptions of the student's performance to conformity, ethicality, 
lika^ility, extraversion, popularity, anxiety level, or altruism. Students 
who are perceived as likyhle and cooperative, honest, or nobly altruistic 
are nice to have around, regardless of performance level j nevertheless, such 
perceptions do not bias evaluation of academic performance. 

Finally, brief note may be taken of the third factor, defined by the 
residual variance in SAT-V (and, incidentally, SAT-M) apart from that re- 
lated to perception of perfoimaance and desirability. Loadings of rating- 
scale variables on this factor are generally low, with the major proportion 
of the variance absorbed by the first two factors. The highest loadings, 
however, occur for variables in the areas of intellectual values, creativity, 
and open-mindedness, for the analytical ability and grasp of abstract 
variables under intellectual ability, and for some conformity variables - 
This suggests that the substantial SAT residual may in part still be visible 
to the faculty in these terms. The intellectual values area may indicate 
students who deploy their abilities, interests, and energies in directions 
different from those Involved in course work or manifestations of desira- 
bility, and the creativity variables iriay reflect similarly unreia ‘ i acts 
or events in which verbal or symbolic skills are visibly reflected. 

The loadings of the SAT residual in the area of open-mindedness, if 
real, are more difficult to interpret. Tne best conjecture would seem to 
be that brighter students may have more Interest in Intellectual inquiry and 
exhibit it through continued receptivity to nev ideas- The fact that this 
variance goes beyond performrnce end desirability may be due to the student's 
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j^oing beyond what would satisfy the instructor; The brighter student may 
continue to seek and incorporate new evidence even though the instructor is 
satisfied* 



Summary 

A ^.revious study had employed the diagonal method of factoring to 
partial out that portion of the variance in faculty ratings (of students on 
a variety of traits) that is related to academic performance, to permit 
identif i ■’ation of reliable remaining variance related to ratings of general 
desirability. The present study employed the same data, but focused on 
desirability apart from raters' perceptions of academic performance rather 
than on desirability apart from actual performance. Two questions prompted 
such an analysis: (l) could previous result; s, based upon a consensus, oz* 

average academic performance, be further illuminated by going directly to 
the rater's perception of perfonnance? , and (2) what traits do faculty see 
as compatible with or concomitants of their perception of performance? 

The results tend to show an absorption in the faculty perception of 
performance of much of the variance previously associated with dependability, 
intellectual ability and values, motivation, self-sufficiency/creativity, 
and naturity in defining desirability apart Trom academic performance- The 
results tend, however, to verify or accentuate the contribution of other 
traits, notably ethicallty, likableness, open-mindedness, and altruism. It 
does appear that desirability is highly re laved to perception of academic 
performance, however, and that other areas rii)rmally expected to make an 
honest contribution to performance (e.g., dependability, intellecbua] ability 
and values, motivation, and self-sufficiency ,/creaMvity) are perceived by 
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the fatuity to do so. Finally, there Is reaalnlns reliable variance In SAT 
ima actual grades, as veil as In such previously established areas as con- 

fornity and eitraversion, vhlch is related neither to perception of perform- 
ance nor desirability. 
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